Exploring Automated Classification Approaches to Advance the Assessment of Collaborative Problem Solving Skills.

Competency in skills associated with collaborative problem solving (CPS) is critical for many contexts, including school, the workplace, and the military. Innovative approaches for assessing individuals' CPS competency are necessary, as traditional assessment types such as multiple -choice items are not well suited for such a process-oriented competency. In a move to computer-based environments to support CPS assessment, innovative computational approaches are also needed to understand individuals' CPS behaviors. In the current study, we describe the use of a simulation-based task on electronics concepts as an environment for higher education students to display evidence of their CPS competency. We further describe computational linguistic methods for automatically characterizing students' display of various CPS skills in the task. Comparisons between such an automated approach and an approach based on human annotation to characterize student CPS behaviors revealed above average agreement. These results give credence to the potential for automated approaches to help advance the assessment of CPS and to circumvent the time-intensive human annotation approaches that are typically used in these contexts.

Differential effects of pressure on social contagion of memory.

Collaboration can support performance on a variety of tasks, but recent projects have indicated that group collaborations can also be associated with memory decrements. For example, when people discuss ideas, any shared inaccurate information can be used by group members to complete subsequent tasks. Across two experiments, we examined whether this social contagion is influenced by performance pressures that regularly emerge during group interactions. In Experiment 1, participants under individual-directed pressure, goal-directed pressure, or control conditions studied word lists before completing a collaborative recall with a confederate partner who occasionally recalled incorrect words. We examined whether partner-produced inaccuracies contaminated participants' memories for the list contents on a subsequent individual recall. Goal-directed pressure, focused on monitoring partner accuracy, facilitated subsequent individual recall, as demonstrated by reduced reproductions of partner-generated inaccuracies. In contrast, individual-directed pressure, focused on appearing competent, resulted in greater use of those inaccuracies. Experiment 2 ruled out that the benefits associated with goal-directed pressure were solely due to warning participants about the possibility of social contagion. These results demonstrate that different instantiations of pressure can help or hinder memory-related performance in collaborative settings. Under the right conditions, pressure can help overcome the effects of exposure to inaccurate information. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Advancing the Science of Collaborative Problem Solving.

Collaborative problem solving (CPS) has been receiving increasing international attention because much of the complex work in the modern world is performed by teams. However, systematic education and training on CPS is lacking for those entering and participating in the workforce. In 2015, the Programme for International Student Assessment (PISA), a global test of educational progress, documented the low levels of proficiency in CPS. This result not only underscores a significant societal need but also presents an important opportunity for psychological scientists to develop, adopt, and implement theory and empirical research on CPS and to work with educators and policy experts to improve training in CPS. This article offers some directions for psychological science to participate in the growing attention to CPS throughout the world. First, it identifies the existing theoretical frameworks and empirical research that focus on CPS. Second, it provides examples of how recent technologies can automate analyses of CPS processes and assessments so that substantially larger data sets can be analyzed and so students can receive immediate feedback on their CPS performance. Third, it identifies some challenges, debates, and uncertainties in creating an infrastructure for research, education, and training in CPS. CPS education and assessment are expected to improve when supported by larger data sets and theoretical frameworks that are informed by psychological science. This will require interdisciplinary efforts that include expertise in psychological science, education, assessment, intelligent digital technologies, and policy.